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FOREWORD 



This Manual is designed to accompany staff development sessions 
in which Research and Evaluation personnel will discuss with 
administrators, evaiuators in schools, and area office personnel. 

The assessment and reporting of pupils piogress in the local 
school's instructional program; 

State requirements and concerns in regard to on-going 
evaluation; 

The functioning of an evaluation committee to review 
program implementation, quality, outcomes for students 
and staff, and the match between budget and expenditures; 
and, in schools with School Improvement funding, to 
assess the school environment. 

It is our hope that the suggestions and forms presented in the 
Manual and dealt with during the in-service sessions will make 
evaluation tasks easier. 

All members of the Research and Evaluation Branch staff are ready 
to assist. Please call on any of us if you have questions or 
reed help witn on-going evaluation responsibilities. 

Appreciation is expressed for the County and State resources made 
available for our use, and for the participation of District and 
Administrative Area personnel in planning. Grateful acknowledge- 
ment is made of the special expertise of the Research and 
Evaluation Branch staff members who made up the In-service Plan- 
ning and Development Committee, who organized the in-service 
presentations, and who produced this Manual : Pat Cobb, 
Lola Hendricks, Jack Rea, Herb Rosner, Connie Wesson, and 
Esther Wong. 



ERLC 



SUCCESSFUL EVALUATION* 

To conduct a formative evaluation successfully, all involved 
staff need to have an appropriate mind set. Basically, one 
attitude must prevail: " The evaluation activity is for pro- 
gram improvement . 11 Teachers, principals, and other personnel 
must be convinced that when discrepancies are found between 
"what is" and "what should be," positive constructive action 
will result. If staff members are apprehensive of forthcom- 
ing judgment, it is best not to waste the time and effort it 
takes to conduct the evaluation. There is probably no aspect 
of program evaluation that more than this, requires a sound 
communication network. 



*Excerpt from Educational Program Evaluation Assistance Handbook , 
Office of the Los Angeles County Superintendent of Schools, Division 
of Program Evaluation, Research and Pupil Services, Revised January 
1976, Page 23. (Emphasis added.) 
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SCHOOL LEVEL EVALUATION REQUIREMENTS* 



Schools receiving consolidated application funds must plan evaluation procedures 

to be used in judging the effectiveness of the program and in making decisions 

about the planned program. The school must include in the evaluation plan pro- 
cedures for assessing: 



Title I/SCE 
X 
X 

X 



SI 

X 
X 

X 



. Implementation of the planned program 

. Quality of the program in operation 

. Outcomes of the program for students 
and staff 

. Match between planned budget and 

expenditures X X 

. Educational achievement of the 
participating students in basic 

skills (Annually) X 

. Progress of LES/NES students in an a, b, 
or c bilingual instructional program 

• Effectiveness of BILP services 

. The School Environment X 
Who Must Be Involved in Evaluation of the Program? 
There must be opportunities for involvement of: 
. Parents 

. Community Persons 

. Classroom Teachers 

. Other School Personnel 

. Students (Secondary Schools Only) 

What are Written Requirements for Ongoing Planning and Evaluation': 

A description must include: 

. Areas of emphasis 

The evaluation processes used 
• The evaluation procedures used 



Bilingual 



X 
X 



*Excerpts from School Program Development Manual for Schools Funded Through 
the Consolidated Application , 1980-81. 
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EVALUATION-COMPLIANCE ISSUES 

Program evaluation procedures are assessed by State program review teams to 
determine if schools are carrying out evaluation procedures mandated by State 
and Federal laws and regulations. Listed below are evaluation points of 
inquiry contained in the 1979-80 School Program Compliance Review Screening 
Instrument and the sections of law or regulation which are the bases for the 
points of inquiry. The information and procedures outlined in this manual 
are designed to assist schools to, be in compliance with these evaluation 
requirements. ' \ 



UNLESS OTHERWISE NOTED, ITEMS APPLY TO ALL SCHOOLS, REGARDLESS 
OF FUNDING SOURCE (Sf) RECEIVED,* 



Authority 

(i) 



Points of inquiry 
(2) 



EC §52021 



The SSC, with the principal, teachers, and 
".her school personnel, is reviewing the im- 
plementation of the school improvement pro- 
gram and is assessing, periodically, the 
effectiveness of the program. 



TI 
T5 



§125 
§4101 



The SAC is involved in planning, implement- 
ing, and evaluating the program for partici- 
pating students. 



VIII # EVALUATION 



EC §52015(g) 40. 
15 §4422 
TI §124 



The school has established and is implement- 
ing procedures for periodic evaluation of 
the program. 



NOTE: This item applies to schools receiving 
Title I/SCE funds. 



T5 
TI 



§4101 
§124 



There is evidence that the district govern- 
ing joard has reported results of the annual 
evaluation of the compensatory education pro- 
gram to the SAC. 



* 1979-8Q School Program Co liance Review Screening Instrume nt, California State 
Department of Education 
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ORGANIZING AND IMPLEMENTING PROGRAM RELATED EVALUATION 



In order to implement program related evaluation according to the mandates each 
school will need to determine who will assume the responsibility and then develop 
both a structure and the steps necessary to organize the evaluation activities 
for Lheir local program. To accomplish this it is recommended that an evaluation 
committee be established. The basic criteria for the committee and the process 
a school might use to establish such a committee are as follows: 



Evaluation Committee 

I. Functions 

A. Oversees the monitoring and evaluation of the: 

1. Implementation of the planned program 

2. Quality of the program in operation 

3. Outcomes for students and staff 

4. Match between budget and expenditures 

5. Assessment of school environment (SI only) 

B. Responds to the needs related to evaluation and recommendations by 
other school groups 

C. Plans monitoring and evaluation activities 

D. Assigns specific tasks for collecting, organizing and analyzing data 

E. Makes recommendations, based on evaluation findings, for decision-making 

F. Disseminates information to other committees/staff /groups 

II. Committee Composition 

A. A typical committee should have 8-12 members 

1. Principal 

2. Evaluation Coordinator or (secondary) Compensatory Education 
Coordinator or Counselor 

3. Grade level or department chairperson representatives (by grade, 
subject , or cluster) 

4. Aide/TA representative 

5. Parent representatives (SSC, SAC and BEC) 
/ 6. Resource representative 

7 . Student (Secondary) 

3. Research and Evaluation Branch staff member 
3. Responsibility 

1. Each member represents a particular group, and therefore must bring 
information to the committee as well as provide information to the 
group he/she represents, 

2. Effective evaluation requires the support of all committee members 
as well as the various school groups. 

3. One person should be selected to have overall responsibility for 
coordinating evaluation activities. This could be the Evaluation 
Coordinator/Secondary Compensatory Education Coordinator or a 
counselor. 

4. Each member should be willing to participate actively on the committee. 



eps in Organizing and Implementing the Evaluation Committee in a School 
Planning meeting among administrator, evaluation coordinator/Compensatory 
Coordinator or counselor and R and E staff member to discuss: 

1. Amount of support the principal will provide 

2. Rola, of the committee in che schooi 

3. Number and categories of people on the committee 

4. Principal's goal for committee 

Concept of the Evaluation Committee introduced to staff and parent 
groups 

Committee member selection - Use methods the school normally uses for 
peer selection 

Initial committee meeting 

1. Research and Evaluation Branch staff member present 

2. Review the purpose of the committee 

3. Establish a time/task calendar (See suggested model on page 5.) 

4. Review roles/responsibilities of individual members 

Successive (monthly) meetings 

1. Follow the time/task calendar 

2. Revise the time/task calendar as necessary 

3. Record committee activities 

End-of-year evaluation of committee activities 

1. Committee self evaluation 

2. Staff and parent group evaluation 

3. Recommendations of next year's committee 

a. Areas to monitor and/or evaluate 

b. Changes in committee composition or operation 

4. Documentation of committee activities 

5. Prepare, present and disseminate evaluation findings to 
appropriate groups 

End-of-year Evaluation Report (See page 30.) 
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EVALUATION COMMITTEE TIME TASK CALENDAR 



1. — Organize an evaluation committee 

2. — Review school plan for content and relevancy . . . . 

3. — Monitor and review information on pupil progress . . 

4. — Monitor program for degree of implementation of 

solution procedures ....... ..... 

5. — Monitor extent to which objectives are being met 

(Interim and outcome) 

6. — Monitor selected program areas for quality 

7. — Interpret results of tests/surveys 

8. — Review state program review procedures and 

instruments with staff and parents 

9. — Provide input for rewriting/updating/modifying school 

plan 

10. — Make recommendations for modifying program as needed 

11. — Maintain records of evaluation committee activities 
to support end-of-year report 

12. — Prepare, present, and disseminate end-of-year 
evaluation report 



X — 



0 N D 



0 N D 



J F M 



A M J 



J F M 



-X 
X 



-X 
-X 



-X 

-X 



X — X 



A M J 



J A 



J A 



J J 
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STEPS IN ASSESSING THE QUALITY |oF A PROGRAM IN OPERA TION 

THE EVALUATION COMMITTEE SHOULD: 

1. List program factors that should contribute to pupil progress 

2. Eliminate those factors over which the school has no control 
3/ Prioritize factors according to their importance 

4. Decide the best way to investigate or evaluate the first priority. 
Define responsibility, time, and how data will be collected and 
analyzed. (Develop an evaluation plan.) 

5. Implement the evaluation plan 

6. Make recommendations based on^the analysis of the data 

7. Review priority list (Step 1), revise as necessary, and repeat 
steps 4, 5 and 6 




DIRECTIONS FOR USING MONITORING PROGRAM IMPLEMENTATION FORM 

Monitoring Program Implementation Form 

Enter school name, evaluator, and component. 

C olumn A 

Enter the date the activity was monitored. 
Column B 

Enter the activity being monitored. / 
Column C 

Enter the page number in the school plan where the activity i 
stated or described. 

Columns D and E 

Enter a check mark in tha appropriate box. In column E, for 
"Other," specify the method used. 

— Reference: Program Evaluator' s Guide, The Evaluation 
Improvement Program , California State Department of 
Education, 1979, Second Edition. 
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School 

MONITORING PROGRAM IMPLEMENTATION FORM Evaluator 

Component 



(A) 


(B) 


(C) 


(D) 








(E) 






Date 


Program 
Activities 


Reference to 
School Plan 


Is Activity Taking 
Place As Planned ? 


Evidence Available 




List Activities 
Being Monitored 


Page 
Number (s) 


Yes No 


Not 
Known 


Obser- 
vation 


Records 


Con- 
ference 


*Other 


None 


1. 






□ □ 


□ 


□ 


□ 


□ 


□ 


□ 


2. 






□ □ 


□ 


□ 


□ 


□ 


□ 


□ 


3. 






□ □ 


□ 


□ 




□ 


□ 


□ 


k. 






□ □ 


□ 


□ 


□ 


□ 


□ 


□ 


5. 








□ 


□ 


□ 


□ 


□ 


□ 


6. 






□ □ 


□ 


□ 


□ 


□ 


□ 


□ 


7. 






■ □□ 


□ 


□ 


□ 




□ 


□ 



*Please specify. 
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Schooi Fantastic 



MONITORING PROGRAM IMPLEMENTATION FORM 



Evaluator c * A11 



Component Reading 



(A) 


(B) 


(C) 


Date 


Program 
Activities 


Reference to 
School Plan 


1, lU/l/Ol 


List Activities 
Being Monitored 
Learning centers 
based on students 1 
instructional needs 
and interests. 


Page 
Number(s) 

13 


o 1 0/1 /ftl 


Assist in the de- 
velopment of effec- 
tive classroom aides 
through in-service. 


1/. 


3. 




\ 
V 


4. 






5. 






6. 






7. 






*?lease specify. 



(D) 
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Is Activity Taking 
Place As Planned ? 



Not 

Yes No Known 



□ □ 



Q0 □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 

□ □ □ 



(E) 



Evidence Available 



Obser- Con- 

vation Records ference *Other None 



□ □ □ □ 

□ □ jefn 



□ □ □ □ □ 

□ □ □ □ □ 

□ □ □ □ □ 

□ □ □ □ □ 



□ □ □ □ □ 

IS 
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DIRECTIONS FOR USING THE CLASS PROGRESS FORM 

CLASS PROGRESS FORM 

Enter grade level program objective, subject, room number, teacher f s name, 
grade level and school year. 

COLUMN A 

r 

Enter the names of pupils in the class. (Pupils may be clustered so that 
subgroup progress can be scanned easily.) Examples of subgroups are LES, 
NES, FES, PER; Title I, non Title I; low achievers, high achievers, etc. 

Add new pupils to the roster as they enroll. If the clustering of sub- 
group procedure is used, leave space between the groups for additional 
names. 

COLUMN B 

Enter the language status of each pupil. LES-Limited English Speaker, 
NES=»Noh-English Speaker, FES^Functional English Speaker, PES^Prof icient 
English Speaker. Use BINL results for this information if possible . 

COLUMN C 

Enter pre and post standardized test scores from CTBS class or grade level 
rosters (or other test scores) in percentile rank or any other way deemed 
appropriate and meaningful for the school. 

COLUMNS D-G 

Enter the level (book, unit, step, etc.) the pupil completed as determined 
by the pupil's mastery of a cluster of skills in connection with the book, 
unit, step, etc. Mastery of skills is determined by procedures and cri- 
teria established by the school. 

Enter the level each pupil completed by September and at each of the in- 
terim periods. Interim periods may be changed. 

Total the completed levels for all pupils and enter the results in the sum 
cell for each interim. Determine the average placement for the class (each 
interim) by dividing the sum by the number of pupils with a completed level 
indicated for that interim. 

COLUMN H 

Determine total growth of each pupil by counting the number of levels 

completed (e.g., number of books, steps, etc.) as indicated in Columns D-G 

and enter in Column 
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COLUMN I 



Enter the annual gain only , reporting total growth for just those pupils 
enrolled September through May (and which, therefore, can be said to have 
an annual gain) • 

Total the annual gain and record in the appropriate cell. Determine the 
average annual gain for the class by dividing the sum by the total number 
of pupils enrolled September through May and enter into the appropriate 
cell. 

COLUMN J 

Use this column as necessary to comment on individual pupil progress. 



11 



Research and Evaluation Branch 
Los Angeles Unified School District 

7/80 



OPTIONAL 

Program Objective^ 



CLASS PROGRESS FORM 
Subject 



Room #_ 
Teacher_ 
Grade 



Year 



Pupi- 1 B 


Language 
FES, PES 

fpfl NFS 


SD* 


Level 
Completed 
By Sept* _ 


Level 
Completed 
By Nov._ 


Level 
Completed 
By Feb. 


Level 
Completed 
By May 


Total 

uruw vii 


iUutuai 

Gain 


Analysis 01 rupij. iTOgress 


rre 


rOS t 


1 • 






















0 

£• . 






















Q 

D . 






















A 

H • 






















s 






















A 






- - 














■* 


7 






















ft 






















Q 
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11. 






















12. 






















13 






















14 






















15. 






















16. 






















17. 






















IB. 
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•SO » Standardized Data 
♦•Annual Gain « number of lcvolo pupilo nohiovod Sept. -May 
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Avorage annual gain-sum of 
Sept. -May gain-rnumbor of 
pupils enrolled Sept.-May 



DIRECTIONS FOP USING THE GRADE LEVEL PROGRESS SUMMARY FORM 
AND THE SCHOOL LEVEL PROGRESS SUMMARY FORM 



GRADE LEVEL PROGRESS SUMMARY FORM 

Information for this form is taken from Class Progress Form. 
Enter Grade level, subject area and grade level program objective. 
COLUMN A 

List classes by teacher or room number. 
COLUMNS B-F 

Enter the average completed levels for each class at entry (Sept.) and 
at each interim as recorded on Class Progress Forms in columns D, E, F, 
G. Also enter average annual gain. 

Total each column and enter this figure in the sum cell. Determine the 
average number of levels completed or the average annual gain by diviJin 
the sum of each column by the number of classes. 

Determine the average growth at each interim by subtracting the current 
average achievement level from the preceeding average achievement level. 

NOTE: This form may also be used to summarize progress information for 
subgroups of pupils. 



SCHOOL PROGRESS SUMMARY FORM 
COLUMNS A-F 

For every grade (using information recorded separately on each Grade 
Level Progress Summary Form) enter the average achievement level at 
entry (column A) and at each interim (B-D), plus the average annual 
gain (E) and the program objective (F). 
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OPTIONAL 



Grade Level Progress Summary Form 

Subject 

Program Objective 



(A) (B) (C) (D) (E) (F) 



Class/Teacher 



Level 
Completed 
By Sept. 


Level 
Completed 
By Nov. 


Level 
Completed 
By Feb. 


Level 
Completed 
By May 


Annual Gain 
(Matched^ 




































— 


. . 




















































































Sum 

Average Achievement Level 






















♦ 


Average Growth 









*Use Information from Class Progress Form 



EMC 
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OPTIONAL 

School Progress Summary Form 
Subject 

AVERAGE ACHIEVEMENT LEVEL 



( A > (B) (C) (D) (E) (F) 



Grade 


Level 
Completed 
By Seot. 


Level 
Completed 
By Nov. 


Level 
Completed 


Level 
Completed 
Dy rxay 


Annual Gain 
(Matched) 


Program 
Objective 


K 














1 














2 














3 














4 














5 














6 















*Use information from Grade Level Progress Summary Form 

l 



ERIC 



Loa Angeles Unified School District 
Research and Evaluation Branch 

7/80 



I 



DIRECTIONS FOR USING 
THE GRADE LEVEL FREQUENCY DISTRIBUTION CHART FORM 

AND 

THE SCHOOL FREQUENCY DISTRIBUTION CHART FORM 

GRADE LEVEL FREQUENCY DISTRIBUTION CHART FORM 

This form may be completed in September (pre) or at the end of the year 
(post) . 

Enter the subject and grade level. 

List the classes by teacher and or room. 

Count the number of pupils performing at each level, based on the informa- 
tion on the Class Progress Form. Enter this number in the appropriate 
cell. 

NOTE: This form can be used as a tally sheet. 

SCHOOL FREQUENCY DISTRIBUTION CHART FORM 

This form is completed in the same way as the form above, except that 
the information is taken from the grade level total cells of each Grade 
Level Frequency Distribution Chart. 



Research and Evaluation Branch 
Los Angeles Unified School District 

7/80 
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OPTIONAL 



GRADE LEVEL FREQUENCY DISTRIBUTION CHART* . 

Subject 

Grade Level 



Pre (Sept.) 
Post (Hay) 



Names of Books or Levels 






































































\ 




























































































































































— t 


















































Grade Level Total 



































*Use Information from Class Pupil Progress Form 



Los Angeles Unified School District 
Research and Evaluation Branch 



7/80 



OPTIONAL SCHOOL FREQUENCY DISTRIBUTION CHART* Pre (Sept.) 

Subject Post < Ma y> 




2 



3 



4 



5 



6 



School Total 



L03 Angeles Unified School District 
Research and Evaluation Branch 
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MANAGEMENT REVIEW RECORD OF PROGRAM OUTCOMES 



The Program Management Review Record can be used to monitor the program outcomes 
during the course of the program as well as at the end of the program. Changes 
may be made to correct a possibly serious deficiency or a not-so-critical but 
nevertheless important omission in time to make an impact on the final outcome. 



DIRECTIONS FOR USING THE MANAGEMENT REVIEW RECORD 



Enter the name of the school and reviewer. 
Column A: Enter the date of the review. 

State the component or area of the objective. 
Write the objective as stated in the school plan, 



Column B 
Column C 
Column D 



Column E: 



Column F: 
Column G: 

Column Gl: 
Column G2: 



Give the page number in the school plan where the stated objective 
may be found. 

A projection. As of the review date, do you predict that the 
objective will be fully completed within the time stated? Place 
a check in the column below "Yes" or "No." 

If the projection is "No," continue to Column F. 

What is the reason for the deficiency? Why will the objective not 
be realized within the stated time? 

Suggested action to correct deficiencies, A number of course cor- 
rections, however slight, at this time, may influence the outcome 
in the desired direction. 

Person responsible, (It helps when one individual assumes respon- 
sibility for movement toward a desired outcome,) 

Action to be taken. List the possible course corrections agreed 
upon to effect movement toward the desired outcome. 



Column G3: By what date? Setting a date facilitates the completion of the 
task undertaken. 



See example page, 



Adapted from: Program Evaluation Guide, The Evaluation Improvement Program , 

California State Department of Education, 1979, Second Edition, 
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MANAGEMENT REVIEW RECORD ocnooi _ 

OF PROGRAM OUTCOMES Reviewer 



A 

Review 
Date 


B 

Component/ 
Area 


C 

Stated 
Objectives 


D 

Reference 
to 

School Plan 
(Pa«e Nos. ) 


E 

Will be Com- 
pleted in 

Time Stated? 
Yes No 


F 

Reason for Deficiency 
(if not completecble ) 


Suggested Ac 
1) Person(s) 
responsible 


G 

bion to Correct E 
2)Act-ion to 
be taken 


eficiencies 
3) By what 
date 


N) 

H 

ERJC 
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MANAGEMENT REVIEW RECORD 
OF PROGRAM OUTCOMES 



'eft* 



School 



Fantastic 



Reviewer A. Super Reviewer 



Review 
Date 



1/18/81 



1/18/81 



ro 




B 

Component/ 
Area 



Parent 
Involve- 
ment 



Staff 
Develop- 
ment 



JO 



Stated 
Objectives 



By May 1981, at least 
40 parents of partici- 
pating pupils will have 
provided volunteer help 
in the classroom, as 
shown on records kept 
in the office. 

By May 1981, staff and 
volunteers will, on the 
average, indicate an 
increase in skills and 
knowledge on at least 
60% of the identified 
needs covered in S.D. 
as measured by a p re- 
post questionnaire. 



Reference 
to 

School Plan 
(Page Nos y ) 
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E 

Will be Com- 
pleted in 
Time Stated? 



Reason for Deficiency 
{if not completeable) 



Other priorities 
intervened 



Insufficient Lime 



Suggested Action to Correct Deficiencies 



1) Person (s) 
responsible 



S.D. Com- 
mittee 



2) Action to 
be taken 



Reevaluation 
of S.D. prior- 
ities 

Setting aside 
blocks of time 



3) By what 
date 



2/1/81 



3 / 



\ 

DIRECTIONS FOR ASSESSING THE MATCH BETWEEN BUDGET EXPENDITURES AND THE SCHOOL PLAN 

I. Background 

"Each school with School Improvement, Title I/SCE, or Preschool funding must 
plan evaluation procedures [that]. . . include an assessment of the match 
between expenditure and the planned program budget, 11 * 

In order to do this, . . a school might choose to examine several areas. 
Among these areas might be the percentage of funds allocated for personnel, 
the percentage for capital outlay expenditures, the amount of carryover 
funds, the frequency of transfers araoung budget categories, or the adequacy 
of internal control procedures. 11 ** 

II. Questions to cons ider : 

A. Personnel 

1. What percent of the ';otal budget was allocated to personnel? 

2. Were the number and types of persons budgeted consistent with District 
guidelines? (See memo from J. Leon, "Staffing Guidelines for 
Special Programs, 11 April 9, 1980 on next page.) 

3. Are the duties/activities of such personnel described in the school 
plan? 

4. Are the activities of personnel effective in helping the school 
meet its program goals? 

B. Capital Outlay 

1. What percent of the budget was spent on this category? 

2. Were expenditures justified in terms of the needs expressed in the 
plan? 

3. Was th* use of items purchased described in the plan? 

C. Carryover Funds (School improvement only) 

1. Does the am unt of carryover money indicate the budget planning 
was effectively done? 

2. If not, how might allocated funds have been spent to support the 
program effectively? 

D. Frequency of Budget Transfers 

1. Of the budget transfers made this year, how many were responses to 
modifications in the plan? Could the others have been avoided by 
more careful planning during the budget preparation? 

2. Were the transfers made justified by the content (original or modi- 
fied) of the plan? 

E. Adequacy of Internal Control Procedures 

1. Is responsibility for fiscal management clearly defined? 

2. Are budget books/ledgers kept current? 

3. Are expenditures consistent with priorities outlined in the plan? 

4. Are all available funds being expended on schedule? 

*Calitornia State Department of Education, School Program Developme nt Manual 
1980-81 , pp. 16-17. ~ ' L 

**California State Department of Education, Addendum to Chapter II of the 

Handbook for the Evaluation of Multifunded Programs: 2nd revised edition , p. 5. 
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INTER-OFHCE CORRESPONDENCE 
los Angeles United School Distwct 



r0: Principals, Schools with Scecial Funding Date April 9 » ' ;S8C 

FROM: ^a_Le^n,^Associata Superintendent 
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.•/. Jordan Ccto. Ed. Field Coordinators CR. Caldwell 

Linsccr.b Sfciz-jfco Akasaki 
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ASSESSING SCHOOL ENVIRONMENT 



I. Background: 

School environment refers to the physical and emotional climate in which 
learning takes place. Factors contributing to the emotional climate include 
student motivation and initiative, standards and expectations for achievement 
and behavior, freedom for self-expression, and an atmosphere of respect for 
self and others among students and staff. The physical environment of the 
classrooms and schoc? include such factors as grouping, orderliness, clean- 
liness, and attractiveness of the physical plant and grounds.* 

All schools receiving a Program Quality Review are assessed as to the quality 
of the school environment, regardless of funding* Schools receiving School 
Improvement funding must also assess school environment as a part of their 
yearly evaluation.** 

II. Directions for using the School Environment Profile Form 

A. Distribute the survey forms to a variety of constituencies: 

1. Administrators 

2. Coordinator/Resource staff 

3. Teachers 

4. Aides/TAs 

5. Parents/Volunteers 

6. Students (Secondary only) 

7. Other (specify) 

B. If you need data for plan writing : 

1. Tabulate data for both columns (A & B) . 

2. Use WHAT IS (Column A) for "Existing Conditions". 

3. Use WHAT SHOULD BE (Column B) for "Desired Condition". 

4. Compute the difference between Columns A & R (B-A) for "Discrepancy". 

5. Write program objectives and activities based on data. 

C. If you need data for evaluating school environment only : 

1. Tabulate data for Colmnn A only. 

2. Use as end-of-the-year evaluation of the environment of the school. 
Make decisions for change (or no change) based on data. 

3. Use same data as pre-assessment of environment for the following year. 



* California State Department of Education, Handbook for Assessing an Elemen tary 

School Program , p. 111-16. 

* California State Department of Education, School Program Development Manual , 

1980-81 , p. 17. 
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School name 



SCHOOL ENVIRONMENT PROFILE 



Category: Mark one (X) 
Administrator 
Coordinator/Resource 
Teacher 
Aide/TA 

Parent /Volunteer 
Student (Sec. only) 
Other: please specify 



The answers to these statements will be used to estimate the way your school is 
viewed by the st^ff and students. There are no right or wrong answers. Just 
answer each statement according to the way you feel about it. Do not put your 
name on this survey. 



DIRECTIONS : 

1. Read each statement. 

2. Respond to each statement twice; once to indicate "what is," and once to 
indicate "what should be." 

3. Mark the items by placing an X on the line above the number corresponding 
to your answer choice. 



EXAMPLE: 



The school is an enjoyable 
place to be. 
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WHAT SHOULD BE (B) 
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4. Return your completed survey to: 



Thank "ou for your participation. 



Adapted from: 
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California State Department of Education, Measuring and Evaluating 
Affective Growth in School Programs 
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SCHOOL ENVIRONMENT PROFILE 



SUBCATEGORY 



PART A: GENERAL CLIMATE FACTORS 



WHAT IS 
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RESPECT/TRUST 



MORALE 



INPUT 



SCHOOL RENEWAL 



CARING 



OPPORTUNITY 
FOR LEARNING 



INDIVIDUAL 

PERFORMANCE 

EXPECTATIONS 
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1. Students are treated with 
respect by teachers. 

2. Students can count on teachers 
to listen to their side of the 
story and to be fair. 

3. Students feel enthusiastic 
about learning in this school 
and enjoy coming to school. 

4. I feel that my ideas will be 
listened to in this school. 

5. ' Parents are considered by 

this school as important 
contributors. 

6. Changes in educational pro- 
grams are based upon the 
particular needs of this 
community and school. 

7. There are persons in this 
school upon whom I can rely. _ 

8. The staff really cares about 
students. 



PART B 
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PROGRAM DETERMINANTS 



Each student's special abil- 
ities (intellectual, 
artistic, social or physical) 
are challenged. 



10. Students know the basis for 
the evaluation of their 
classrootfi work. 

-.1. Performance expectations are 
tailored to the individual 
strident. 

12. Teachers use a wide range of 
teaching materials and media. 
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WHAT IS 



WHAT 
SHOULD BE 



VARIED LEARNING 
ENVIRONMENT 



FLEXIBLE 
CURRICULUM 



SUPPORT TO 
LEARNER 



VARIED REWARD 
SYSTEMS 



PROBLEM SOLVING 
ABILITY 



EFFECTIVE 
CO^fMUNICATION 



INVOLVEMENT IN 
DECISION MAKING 
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13. Students have opportunity for 
learning in individual, small 
group, and classroom groups. 

14. A student with special prob- 
lems get3 help. 



16. 



Students are given alternative 
ways of meeting curriculum 
requirements. 

High school extracurricular 
activities and/or elementary 
enrichment activities appeal 
to all types of students. 



17. 



The school's program encour- 
ages students to develop 
self-discipline and initiative/ 1 



18. Students can get close super- 
vision without feeling "put 
down." 

19. Staff enforces the rules 
fairly* 

20. The staff lets students know 
when they have done some- 
thing .particularly well. 

21. Staff members are recognized 
when they do something well. 

PART C: PROCESS DETERMINANTS 

22. If I have a school-related 
problem, I feel there are 
channels open to me to get 
the problem worked on. 

23. Teachers are available to 
students who want help. 

24. Parents c^n get specific 
information about their child. 

25. Staff members and parents 
freely discuss problems and 
ideas with one another. 

26. Teacher* are involved in de- 
ciding priorities in their 
programs. 
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WHAT IS 



WHAT 
SHOULD BE 
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ADEQUATE 
RESOURCES , 



PART D: 
27 



MATERIAL DETERMINANTS 



SCHOOL PLANT 



There are sufficient staff in 
this school to jneet the needs 
of its students. 

28. The instructional materials 
are adequate for our school 
program. 

29. Teachers and students are able 
to get the instructional 
materials they need at the 
time they are needed. 

30. It is pleasant to be on this 
campus, it is kept attractive 
and in good repair. 

31. The school has adequate space 
facilities for the program it 
has planned. 



ERLC 



44 



29 



DIRECTIONS FOR END-OP-YEAR EVALUATION REPORT - FORM (SUGGESTED) 



Schools with programs funded through the Consolidated Application must develop 
a method of reporting evaluation information about their program to parents, staff, 
students (in secondary schools), and to the district.* The following suggested 
outline and format may be used by the committee in fulfilling this mandate. ' 
The outline is based on the areas indicated in the mandates and may serve as 
a basic guide for the kinds of data the committee will wish to collect during 
the year. The format is simple enough to make it appropriate for dissemination 
to the various audiences. It may also be adapted to fit individual school 
requirements. 

I. Program Description 

A. Describe the number of pupils, grade ^levels in school, and 
school staff. 

B. Describe significant activities or materials used in the program, 
if any. 

C. Identify unique or new aspects of the program, if any. 

II. Program Accomplishments 

A. Describe unanticipated outcomes and/or side effects that have 
been observed, if any. 

B. Describe changes observed, such as score or performance gains, 
changes in attitudes, behaviors and environment, if any. 

C. Describe the degree to which the planned budget matched your 
actual expenditures such as the frequency of transfers among 
budget categories, or the amount of carryover funds (SI only). 

III. Program Evaluation Conclusions 

A. Summarize the general program effectiveness. 

B. Present recommendations, if any, for different approaches in 
those instances In which the objectives were not met. 



California State Department of Education, Addendum to Chapter III of the 
Handbook for the Evaluation of Multifunded Programs : 2nd revised edition , p P# 8-9. 



California State Department of Education, School Program Development Manual , 
1980-81, p. 31. 
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School End-ofVfear Report of Program Accomplishments 
19 - School Year 



PROGRAM DESCRIPTION 

A. Pupils, grade levels and staffing 

. Grade levels served 

. Number of pupils 

• Number of classrooms 

B. 

C. 

PROGRAM ACCOMPLISHMENTS 
A. Unanticipated outcomes, if any 



. Number of classroom teachers 
. Number of aides/TA's 
. Number of non-classroom 
support staff (specify) 



Significant activities and materials, if any 



/ 

Unique or new program aspects, if any 



B. Changes observed, if any 

C. Degree of match between, planned budget and actual ^expenditures 

PROGRAM EVALUATION CONCLUSIONS 

A. Summary of general program effectiveness 

B. Recommendations for different approaches for objectives not met, if any 
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ATTAINMENT OF OBJECTIVES 



*Rating Scale School _ 

1 » No attainment 

2 » Limited attainment Reviewer 

3 ■ Substantial attainment 

4 ■ Complete attainment 



Component/ 
Area 



Page -in 
School Plan 



Population 



Objective 



Level of 
Attainment 



Objective 
Rating* 



Reason (s) for 
nonattainment 
(Ratings 1,2,3) 



Recommendations for 
objective revision, 
if applicable 



CO 



4/ 
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School Fantastic 



ATTAINMENT OF OBJECTIVES 



. * Rating Scale ______ 

1 ■ No attainment 

2 m Limited attainment Reviewer Weir M» Proven 

3 ■» Substantial attainment 

4 ■ Complete attainment 



Component/ 
Area 



Reading 



ReadiQg 



co 

CO 



[ERIC 



Page in 
School Plan 



15 



15 



Id 



Population 



K 



1-3 



Objective 



80% 



2 level 
average 



Level of 
Attainment 



70% 



2 level 
average 



Objective 
Rating* 



Reason(s) for 
nonattainment 
(Ratings 1,2,3) 



Introduced new pro- 
gram; materials 
arrived late 

Systematic program 



Recommendations for 
objective revision, 
if applicable 



No change 



Increase to 2.5 level 
average 
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PRQGRAM RELATED EVALUATION 
STAFF DEVELOPMENT PACKAGE 

Basic Script 



US OEPARTMENT OF tOUCATION 

NATlONAl INSTITUTE 0* CDUCATlON 
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A' - m A •-.* l jt I ,HAN"f D BY 



Los An^cl of; Unified School District 
Research and Evaluation Branch 
Enierson Manor Office 
July 1980 
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STAFF DEVELOPMENT SESSION 
PROGRAM RELATED EVALUATION 



Mater ials/Notes 



Content 



Introduction 

A. Warm-up 
1. Introduction of leaders and participants 

B. Rationale for Session 

1. In a memo to our District, the State 
Dept. of Educ. described the procedures 



2. 



II. 



for Ongoing Planning found in our school 
plans as "inadequate." The plan-reading 
process within the District this spring 
confirmed that this was a continuing 
need. 

Last year in our inservice sessions, we 
introduced 

a. A process for on-going planning and 
evaluations 

b. A procesa'by which pupil progress can 
be assessed in the local school 
instructional program. 

c. The concept of an Evaluation Commit- 
tee as a means through which the on- 
going planning and evaluation process 
could take place. 

Some schools were not able to implement 
the process this past school year for 
various reasons, but in other schools, 
we have had the opportunity to observe 
and participate in the implementation of 
the procedures recommended in our in- 
service sessions of last summer and 
fall. 

This meeting is an attempt to share with 
you some refinements in, and additions 
to the process based on this past year f s 
experience, and an attempt to answer the 
concerns of the state. 



(TRANSITION STATEMENT) Before launching into an 
inservice on evaluation, we probably need to lay 
to rest the inevitable question of "Why evaluate 
at all? 11 Naturally we are eager to answer that 
question, and our answer will take two direc- 
tions: 

First, we evaluate because we must (we are 
under legislative mandate to evaluate) 
Legislative Mandates 

1 • The 1980-81 School Program Developmen t 
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A. 



Manual (p. 16) states that: 
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Content 




* 

a* ,f Each school with SI, Title I/SCE 




funding must plan evaluation proce- 




dures to be used in judging the 




effectiveness of the program and in 




tne moditication ot the program* 


Transparency 1 


d. blmply put, each school must address 




tne following: 




1) Implementation of the planned 




program - 




2) Quality of the program in 




operation - . 




3) Outcomes of the program for 




students/staff - 




4; Match between planned budget and 




actual expenditures - 




ol only, Assessment of the school 




environment 




c. There must be opportunities for the 




involvement of parents, community 




representatives, classroom teachers, 




other school personnel, and students 




(secondary schools only) in the eval- 




uation of the planned program. 




d. These evaluation requiremencs are re- 




stated on page 1 in your manual as 




well as the evaluation compliance 




issues on page 2. 




B. Second, and more important we evaluate be- 




cause of the real benefits derived from the 




process* 




x. improvement ot the instructional program 




2. Provide information about the progress 




of individual children which will help 




the teacher tailor learning experiences 




to meet individual needs. 




j. identity children, teachers and grade 




levels who need the services of the 




resource staff* ^ 




4. Provide direction for staff develppment 




to meet program needs. 




j. Provide direction/ information for prin- 




cipals in their role as: 




a. Supervisor of instruction 




b* Program Manager responsible for allo- 




cation of resources - time, budget, 




personnel 




x c. Interpretor of school program to 


I 
! 


staff and coirnunity 

i 
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Content 



III, Having stated our thesis that evaluation is not 
only required but in your best interests, we 
hope to demonstrate to you how it can be accom- 
plished so as to maximize benefit and minimize 
effort. 

A. Evaluation Committee - 

1. Function - 

a. Oversee the monitoring and evaluation 
of 

1) Implementation of the planned 
program 

2) Quality of the program in opera- 
tion 

3) Outcomes for students and staff 

4) Match between planned budget and 
actual expenditures 

5) Assessment of school environment 
(SI only) 

b. Respond to the need s/recoicmendat ions 
of other groups 

c. Plan monitoring and evaluation 
activities 

d. Assign specific tasks* in collecting, 
organizing and analyzing data 

e. Make recommendations for decision- 
making based on Evaluation findings 

f. Disseminates information to other 
committees/staff /groups 

2. * Composition of committee 

a. Someone in the school must be given 
the overall responsibility for eval- 
uation, but an effective evaluation 
requires the kind of broad-based sup- 
port that typically comes with re- 
sponsibility shared by various groups 
in the school. 

b. While the use of a committee organi- 
zation is not mandated, we feel that 
it is the most efficient way to 
organize for effective evaluation. 
Remember you are required to provide 
opportunities for parents, community 
person, classroom teachers, other 
school .personnel and students in the 
evaluation of the school f s program. 
So therefore we reconmend that a 
typical committee could be composed 
of: 

1) Principal 

2) Evaluation Coordinator /Compensa- 
tory Education Coordinator or 
Counselor (Secondary) 
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Content 



Grade level or department chair- 
person representatives (by grade, 
subject, or cluster) 

4) Aide/TA representative 

5) Parent representatives (3SC, SAC 
and BEC) 

6) Resource representative 

7) Student (Secondary) 

8) Research and Evaluation staff 
member 

Program Evaluation includes the following ^areas: 
Monitoring the Implementation of Planned Pro- 
gram, Monitoring Pupil Progress, Assessing Pro- 
gram Quality, Assessing Student Outcomes, 
Assessing Environment and Assessing the Match 
Between Your School Budget and Planned Expendi- 
tures. Today we'll concentrate on monitoring 
pupil progress and will just briefly mention 
some o* the other areas. 

A. Monitoring the Implementation is checking to 
see if you are doing what you said you would 
do according to the timeline. The emphasis 
is on the program activities. (Solution 
procedures) 

1. Ifonitor all components 

2. Report the information to the Evaluation 
Committee 

3. Make decisions based on the information 
(the decision may be to do nothing) 

4. To assist you, we have developed Program 
Implementation Form which may be found 
on pg. 7-9, 

5. Discuss Form (see directions/sample 
Pg. 9) 

B. Monitoring Pupil Progress 

1. Monitoring pupil progress in the in- 
structional components at regular 
intervals during the year is an impor- 
tant step to assessing quality. And 
it is this information along with the 

. implementation information that will 
provide the direction for quality 
assessment. 

2. This process for monitoring pupil pro- 
gress in your instructional program will 
provide on-going information on pupil 
achi evenent. 
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Content 




3* Rationale for process: Your instruc- 




tional program is the only factor under 




your control by which pupil achievement 




can be improved* Instructional program 




data is the most practical and useful 




source of data that can be obtained and 




used for this purpose throughout the 




year* 




4* Most of you have such information in 




some forn in your schools* We are going 




to share with you a method of collecting 




and organizing the information that you 




have so that it may be interpreted in 




terms of individual pupils, classrooms, 




grade levels, and total school* 




5. Introduce Individual Pupil Progress Form 




a* (Conversion Tables): In order to 




successfully monitor pupil progress, 




you must thoroughly familiarize your- 




self with your own programs* For ex- 




ample, in Reading, you must under- 




stand the scope and sequence, and the 




mechanics (assessment) for moving 


Transparency 5. 


students through the program*. 


1) Take out the working packet and 




find the conversion table for the 




Macmillan R series, which we are 




using for the purpose of explana- 




tion today » Conversion tables for 




the major reading series are 




available from your evaluator* 




2) This table is based on criteria 




for pupil progress as established 




by the publisher* 




3) Notice the following things: 




(a) The first column represents 




the grade levels, from K 




through 6. 




(b) The second column indicates 




the level if and title of each 




book in the series* Notice 




how the £ of books varies from 




one grade to another. 




(c) The third column indicates 




that when a pupil has com- 




pleted all of level 1, Read It 




Yourself I, he has mastered 




33% of the kgn. program, as 




indicated in the 4th column. 
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Transparency 7 



6. 



(d) In the fourth column, the num- 
bers indicate two things: the 
whole $ indicates the grade 
level in the series; the deci- 
mal indicates the portion 
(percent) of that year's pro- 
gram completed. (Ex. the 
completion of Secret Spaces 
, equals the completion of 25% 
of the 3rd grade program.) 

4) Movement through the program means 
mastering all of the skills for a 
particular unit, magazine, col- 
lective, etc. to a predetermined 
level of mastery usually set by 

' ttie publisher. 

5) Usually the skills are identified 
for each instructional unit (col- 
lective, etc.) on a profile or 
record card. (Ex. on next page of 
your packet.) Level 7: When a 
child has completed level 7, he 
should have mastered these skills 
to a certain level, which is usu- 
ally 8(^% on a skills assessment 
test which would also pinpoint 
areas for additional instruction. 

(Indiv. Pupil Prog. Form) How do you 
organize the collected information? 

a. Here are sample data of 2 children in 
a class which we're going to enter on 
a class progress form. 

b. Leader charts in data with audience 
participation for first student for 
entry level only. 

c. Audience charts in other students 

1) Where is each student in the pro-, 
gram? (use conversion table) 

d. Compute entry level average place-* 
ment for the students used in the 
example. 

e^ Fill in data for first student 
though column G. 

f. Fill in data for second student 
through column F. 

g. Complete total growth (col. 4) for 
student ill and //2. 

h. The annual gain column is used only 
for those students who have been in 
the reading program for the entire 
year. 

i. Compute col. K for otudcnt fl only. 
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Transparency 8 



Transparency 9 



Transparency 10 
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j. Col. J is used by the teacher to make 

conments about pupil progress, 
k. Show examples of completed form. 
^ 1) Look at objective. There are 3 

interim periods.. At each interval 
the class should progress approx- 
imately 30% or 1/3 df whatever 
your school objective is. 

2) Look at placement level upon 
entry. 

3) Look at the amount of growth at 
each interim period. 

4) End of year grade 'level placement. 

5) Amount of growth. 
1. Benefits derived. 

1) At this point and time, you are 
only looking at individual pupils. 

2) Coordinators may also utilize the 
form to determine additional re- 
sources or activities to assist 
teachers to meet the needs of 
individual children 

3) Show where this class would be at 
the end of 6th grade if the rate 
of progress remains the same. 

(Grade Level Progress Summary Form) 
Once we have completed the Individual 
Class Forms at an interval, we are ready 
to summarize the information by grade 
level. 

a. Demonstrate — use information from 
sample. 

b. Caution — for purpose of reporting to 
the total staff, the identity of the 
teacher should be omitted. 

c. Benefits 

1) Can identify at a glance class- 
rooms that are deviating from the 
typical pattern of growth for your 
school in either direction. 

2) Can look at a total grade level to 
determine if ifc* is making progress 
at the rate to allow the grade 
level to meet their objective, 

(Schopl Progress Summary Form) Sum- 
marize data for all grade levels, 
a* Demonstrate 
b. Benefits 

1) Can use data for school level 
plan, 

2) Can see at a gla ice those grade 
level » meeting their objectives. 
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J; Can identify grade levels where 




children's progress slows down so 




that you may investigate the cur- 




riculum and instructional tech- 


iiaUbpaicUCy XX 


niques at that level 


9. Grade Frequency Distribution Chart 




a. Discuss prepared data quickly. 

b. Benefits 






1; Can see the number of pupils at 




each level 




2) Has implications for organization 




of labs, ordering of materials, 




organization of classrooms. 




l. v^^ANblTION STATEMENT) Assessing the Qual- 




ity of the Program in Operation 




JL« Thus tar, we nave discussed the process 




for monitoring implementation of pro- 




gram activities and the process for mon- 




itoring pupil progress. Based on these 




two types of monitoring information, 




your committee will be ready to select 




one or more areas for quality assess- 




ment. 




a, Should not assess all components for 




quality at once. 


Transparency 12 


2. Mini-Group Activities-— Task 1. 

a. List the factors that you feel should 
have the greatest impact on pupil 
achievement . 

b. Identify and delete those factors 
over which the school has little or 
no control to effect change. 

c. Prioritize the remaining factors. 

d. Describe the ways in which you could 
investigate or evaluate your prior- 
ity //l. 

e. Group reports back. 

f. Leader identifies commonalities among 
the groups and summarizes. 


Transparency 13 


3. Mini Grpup Activity //2 

a. Assume that the Evaluation Committee 
has investigated the activity and 
these are the results: 

1) The purpose of the directed les- 
sons are not clearly apparent 

2) Children are v not spending suffi- 
cient time oh task 

3) Children arc asked to perform 
skills without adequate directed 
instruction 

4) Disproportionate amount of time 
spent on pencil-paper tasks vs. 




student-teacher interact ion. 





Content 



b. The Evaluation Committee has done the 
job, now. . . 

WHAT SUPERVISION OF INSTRUCTION 
TECHNIQUES OR STRATEGIES CAN YOU 
EMPLOY TO IMPROVE THE QUALITY OF 
THE INSTRUCTIONAL PROGRAM? 

c. Group reports back. 

d. Leader identifies coinnonalities among 
the groups and summarizes. 

. Assessing Student/Staff Outcomes (Measuring 
Your Objectives) 

1. Remember this morning we stated that 
schools must address 

a. Implementation of the planned program 

b. Quality of the program in operation, 
now • • • 

c. Outcomes of the program for students/ 
staff 

2. Assessing student/staff outcomes simply 
means determining the extent to which 
program objectives are attained at the 
end of the year. During the year, you 
should monitor at regular intervals to 
determine the extent to which you are 
moving toward meeting the objectives. 
An example of this is what we did .with 
the pupil progress data. 

3. In your manual on page 21 & 22, a form 
entitled "Management Review RecorcJ of 
Program Outcome 11 has been provided to 
monitor program objectives throughout 
the year. 

4. Discuss forms 

a. Utilize information discussed during 
Pupil Progress Forms to write in 
sample data. 

5. Benefits 

a. Permits you to identify and correct 
deficiencies before the end of the 
school year, so that you can meet the 
objective. 

E. Assessing the match between the planned bud- 
get and actual expenditures. 

1. The State recommends that the school 
consider certain areas in assessing the 
match between the planned budget and 
actual expenditures. 

2. These areas are: 

a. Personnel 

b. Capital outlay 

c. Carryover funds (SI only) 

d. Frequency of budget transfers 

o. Adequacy of internal control pro- 
cedures . 
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3. Budgets and budget processes are so in- 
dividualized from school to school, that 
we are recommending that you refer to 
the questions listed on p. 23 and use 
those appropriate for your program. 
F. Assessing the School Environment is an eval- 
uation mandate for SI only. 

1. However, it is an item that is assessed 
for quality during State Reviews 
regardless of funding. 

2. We have included in your manual, p. 25- 
29 a School Environment Profile which 
you may use or adapt to meet your school 
needs. 

3. Briefly discuss form. 

a. Use for plan writing (needs assess- 
ment) • : 

b. Use in end-of-year evaluation of 
environment. 



Formal vs. Informal Processes 
A. To this point, we have been discussing a 
rather formal approach to the evaluation 
process, however, there is no mandate that 
requires any one of these forms we have 
discussed or any one process* - - 

If you choose to use more informal ways to 
evaluate your school program, you should 

1. Document activities. 

2. Ensure that staff and parents are 
familiar with and can articulate the 
evaluation process to a State Review 
Team. 



B 



VI, 



VII. 



Restraints affecting implementation and effec- 
tiveness of the Committee 

A . Non-part icipa t ion 

B. Teacher Opposition 

C. Logistics for Meetings 

D. Teacher fear that results might be used 
against them 

Implementing Evaluation Committees in Schools 
A. Planning meeting with administrator and 
R & E rep. to discuss: 

1. How much support will principal give? 
2* What will the rcle of the committee be 
in the school? 

3. Number and categories of people on 
committee? 

4. Principal's goals for committee. 
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B. Introduce concept of Evaluation Committee 
to faculty and and parent advisory groups. 

C. Selection of Committee Members 

1. Refer to Ongoing Planning Guide on 
Committee selection. 

D. Initial Committee Meeting 

1. R & E person present 

2. Review purpose 

3. Establish time/task calendar 

4. Review roles/responsibilities of 
individual members 

E. Successive (monthly) meetings — Discuss 
Form, p. 5. 

!• Follow time/task calendar 

2. Revise time/ task calendar as necessary 

F. End of year evaluation by committee should* 
include 

1. Self evaluation by committee 

2. Staff evaluation of committee work 

3. Recommendations for next year T s 
committee 

4. Ways of documenting committee 
activities 



VIII. Conclusion 
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PROGRAM RELATED EVALUATION 
STAFF DEVELOPMENT PACKAGE 
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Los Angeles Unified School District 
RojBcaich and Evaluation branch 
Kmerson Manor Office 
July 1980 



LEGISLATIVE EVALUATION MANDATES 



EACH SCHOOL MUST EVALUATE: 



0 IMPLEMENTATION OF THE PLANNED PROGRAM 

t QUALITY OF THE PROGRAM IN OPERATION 

t OUTCOMES OF THE PROGRAM FOR STUDENTS/STAFF 

• MATCH BETWEEN THE PLANNED BUDGET AND EXPENDITURES 

t SCHOOL IMPROVEMENT ONLY - ASSESSMENT OF THE SCHOOL 

. — - — - >• 

ENVIRONMENT 



INVOLVEMENT - parents 

COMMUNITY PERSONS 
CLASSROOM TEACHERS 
OTHER SCHOOL PERSONNEL 
STUDENTS (SECONDARY) 



1 
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EVALUATION BENEFITS 



PROVIDE STUDENT PROGRESS INFORMATION 

t 

IDENTIFY STRENGTHS AND WEAKNESSES OF THE 
INSTRUCTIONAL PROGRAM 

PINPOINT CHILDREN, TEACHERS, AND GRADE LEVELS 
NEEDING ADDITIONAL SERVICES AND RESOURCES 

PROVIDE DIRECTION FOR STAFF DEVELOPMENT 

PROVIDE INFORMATION WHICH WILL ASSIST PRINCIPALS AS 

— SUPERVISORS OF INSTRUCTION 

— PROGRAM MANAGERS (ALLOCATION OF RESOURCES) 

— INTERPRETERS OF SCHOOL'S PROGRAM 



IMPROVEMENT OF THE INSTRUCTIONAL PROGRAM *** 
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School 

MONITORING PROGRAM IMPLEMENTATION FORM Evaluator 



, Component 



(A) 


(B) 


(C) 


(D) 












Date 


Program ( 
Activities 


Reference to 

School Plan 


Is Activity Taking 

• Place As' Planned ? 


Evidence Available 




List Activities 
Be ins Monitored 


Page 


Yes No 


tfii * 

not 

Known 


uoser— 
vat ion 


Records 


Con- 
ference 


*0ther Kent 


i. 


\ 




□ □ 


□ 

LJ 


n 


/ 


n 


n n 
i — i i i 


2. 


• 




Dp 


□ 


□ 


□ 


□ 


□ n 


f 

3. 






□ □ 

^^^^^ tgua^ 


□ 


□ 


□ 


□ 


□ □ 

\ 1 i in i 








□ □ 


□ 


□ 


□ 


□ 


□ □ 








□ □ 




□ 


□ 


□ 


□ □ 


6. 








□ 


□ 


□ 


□ 


□ □ 


t 

7. 








□ j 


□ 


□ 


□ 


□ □ 



*Plcauc specify. 



MONITORING PROGRAM IMPLEMEN 



(A) 


(B) 


(C) 


Date 


Program 
Activities 


Reference to 
School Plan 


1. 10/1/81 


List Activities 
^Being Monitored 
Learning centers 
based on students 1 
instructional needs 
and interests. 


Page 
Number (8) 

13 


i 10/3/81 


A.- sist in Lhe de- 
velopment of effec- 
tive cia8s;ruum uLdcu 
through In-service^ 


14 














5. 






6. 






7. 








^*Plcouc opecify. 



'N FORM 



School Fantastic 
Evaluator *• C. All' 
Component Reading 



(D) (E) 

i- I 



Is Activity Talcing 
Place A3 Planned ? 


.. Evidence Available 


Not 

Yes No Knovm 


Obscr- 

vuwiqu 


Con- 

Records fcrence 


*0ther 


None 


H71 1 I 1 1 

,ba U. U 








□ 


□ □ 


i i m i i 

LJ-bil U 








□ 




□ 


1 II II I 


□ 




□ 




□ 


n i ii i 
i — 1 1 I i i 


□ 


□ 


□ 


□ 




□□ □ 




□ 


□ 


□ 


□ 


□□ □ 


□ 


□ 


□ 




□ 


□ □ □ 


□ 


□ 




□ 


□ 



. M-icMiUan R Reading Series 



Grid* 


Level 


& Title 


Units Cc^oleted 


Percent of Prot>re«c 




1 


Read It Yourself 1 


all 


.33 




2 


Read It YourseH 11 


all 


.66 




3 


Read It Yourself III 


all 


1.00 


1 


4 


Who Can? 




1. 14 




5 


Lost and Found 




1* 28 




6 


Hats and Bears 


a i i 


1.42 




7 


Amigos 




l.JO 




8 


Ups and Downs 




1.70 




9 


Colors 




1.84 




ll> 


Being Me 


all 


2.00 


2 


11 


Believe Iti 


al 1 






12 


Feelings 


all 


2.50 




13 


Stand Tall 


a! ■ 


2.75 




14 


A Second Look 


a! • 


3.00 


■* 


15 


Secret Spaces 


<*. ; * 


3.25 




16 


Good News 


all 


3.50 




17 


Beginnings 


al * 


3.75 




18 


Endings 


all 


4.00 


4 


19 


Growing 


ai jl 


4.16 




20 


Past Times 


ail 


4.32 




21 


Messages 


*l i 
a 1 1 


4.45 




22 


Cycles 


all 


4>.64 




23 


Impressions 


ali 


4.60 




2U 


A Visit Vith Rosalind 


al 1 

Oil 


!>. QU 


3 


25 


Mor.ents 


a 1 1 

oil 


10 




26 


Bi rds and Feasts 


oil 


5.32 




27 


Signals 


a 1 1 
oil. 


.>. 




28 


bonders 


all 


5.64 




29 


Outlets 


all 


5.80 




30 


The Moonhal 1 


all 


6.00 
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GRADE 2 



MACMILLAN READING PROGRAM 
CLASS ROSTER - READING PLACEMENT 

READING LEVELS* 

NAME SEPT , NOV. FEB. MAY 

B. BROWN 9 9 10 11 

/*V A8V i.oo z.zg 

H. HART 4 5 6 7 



'LEVELS ''COMPLETED 




*£0 • Star&ardlxoA »ata 

**/ O Knin * nunbor of lovclo pupilo achioyod fioj>fct*>:ay 



Avovago annual gain»awn 
Sept ••May gain 4- nv.-nb' 



T 

0* ' ctivc: .90 (..vci.. B c) or a Su ^ jccc /fe at? 4 aLA 

year's, Krov...» In tlu- M.icmlllau rc-idlng pro&. ' 



Tcachc* Jt*<£( 
Crodc g£ , Year 79 /A 



Sum 



Average- 
Placement 



<2o.$4 



/. t>0 



£3.80 



A 70 



<27. 34 



(A) 


(D) 


-- (C > , ^ < E > (P) (0) (K) (I) ' t 3\ 


1 

Pupils 


FES, PES 


c 

• 


PQ3t 


1 tcvoi 

r COJnpXctcU 

By 3opt, _ 


Level 

CowjUctcd 
•Dy Nov._ 


I Level 

Completed 
ny rcb. . 


Lovol 
'Co.'nplctcd 
Dy May 


Total ' 


Ar-nual*' 

Oaln 

Matchod) 


J. 

Analysio or rupil PrccJ 


1. 








/. 


A*f 


l.ao 


LIS 






- 


2. 








/. 70 


A tfV 


J. CO 


a. as 


..53* 






3. 








/. 70 


A*f 


J. CO 





.J0 


- — 




A. 








/.fV 


A*4 






, W 


,41 




5. 








/./V 


A^y 




/.6t> 








6. 








hie 


/^V 


J. 00 


A-aS 


• 55 


.SS 




7. 








A 70 


_ A^ 


l.OO 




.53* 


.SS 




n. 








/./^ 


ajw 


A ^2 


A St, 








0. 


• 








A 70 


U4 


a. do 








10. 










A^y 


A ^ 










n 








A #V 




l.oo 


a .as ' 


.4/ | 






12. 










/. /V 


J. 6 0 




.4/ 


/// 




13. 










a*v 




A. as I 


• V/ 


.4/ 




14. 










A 70 


A 


A 5^ 








15. 












AfV 











J. 03 



*^ -» Standardized Data 
^RJC 1 * 1 0 ain * nunbor of levolo pujilo achicvod Soptf-tfay 




Avorajo annual caln*c\w 



OPTIONAL 

Grade Level Progress Summary Form 
Subject /£e^L*&^jL 
Program Objective . % /Xc^uu,^ & ^^^^^^^ 

< A > (B) (C) (D) (E) (F) 


Class/Teacher 


Level 
Completed 
By Sept, 


Level 
Completed 
By Nov. 


Level 
Completed 
By Feb. 


Level 
Completed 
By May 


Annual Gain 
(Matched) 


/ 


/ / / 


• ICS Q 






< #7 








AfZ 




r 






















































• 












































Sum 

Average Achievement Level 


3-/7 


3- 32 


3.6S 




/.A/ 








A. /Z. 




Average Growth 
*Use information from Class Progress Form 
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Los 


AngeJ 
Rese 


es Unifi 
>arch and 


ed Sc 
Eva] 


hool District 
.uation Branch 
7/80 



OPTIONAL 



School Progress Summary Form 



AVERAGE ACHIEVEMENT LEVEL 





(A) 


(B) 


(C) 


(D) 


(E) 


(F) | 


Grade 


Level 
Completed 
By Sept. 


Level 
Completed 
By Nov. 


Level 
Completed 
By Feb. 


Leve 1 
Completed 
By May 


Annual Gain 
(Matched) 


Program 
Objective 


K 


/ 












1 / 














2 / 




/ 6 9 
























U 




' 1 "T 








( 1 


/ 5 




/ 

/ 










I 6 

— 1 




/ 

/ 

/ 











*Ufce information from Grade Level Progress Summary Form 
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Los Angeles Unified School District 
Research and Evaluation Branch 

7/80 
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GRADE LEVEL FREQUENCY DISTRIBUTION CHART* # 
Subject _ iw. tt f)ivo 
CrnOc Level 2nd 



Pre (.Sept.; 
Tost (Kay) 



Naxcs of Books or Levels 
of Grade Level Proc 




r *Usa Information from Class Pupil Progress Form A 



Los Angeles Unified School District 
Research and Evaluation Branch 



PROGRAM RELATED EVALUATION WORKSHOPS 
GROUP TASK 1 



1. Select a recorder and chairperson. 



2. List the factors that you feel have the greatest impact 
on pupil achievement. 



3. Identify and delete those factors over which the Lchool 
has little or no control. 

4. Prioritize the remaining factors. 

5. Describe ways in which you could investigate or eval- 
uate priority #1. 

6. Report what was accomplished in steps 4 and 5. 

/ 



PROGRAM RELATED EVALUATION WORKSHOP 
GROUP TASK II 

EVALUATION COMMITTEE FINDINGS: 

• THE PURPOSE OF DIRECTED LESSONS ARE NOT 
CLEARLY APPARENT. 

• CHILDREN ARE NOT SPENDING SUFFICIENT TIME' 
ON TASK. 

1 •• CHILDREN ARE ASKED TO PERFORM SKILLS 
WITHOUT ADEQUATE INSTRUCTION, 

• DISPROPORTIONATE AMOUNT OF TIME SPENT ON 
PENCIL-PAPER TASKS VERSUS STUDENT-TEACHER 
INTERACTION. 

WHAT SUPERVISION OF INSTRUCTION TECHNIQUES OR STRATEGIES 
CAN YOU EMPLOY TO IMPROVE THE QUALITY OF THE INSTRUCTIONAL 
PROGRAM? 



MANAGEMENT REVIEW RECORD 
OK PROGRAM OUTCOMES 



School 



Fantastic 



Sato' 



8 

Area 



1/48/81 



Parent 
Involve- 
ment 



718/81 I Staff 

Devclop- 
r*ent 



Stated 
Objective* 



By May 1981, at least 
40 parents of partici- 
pating pupil* will have 
provided volunteer 'help 
in the classroom, as 
shown on records kept 
in the office. 

i*y May 1981, staff and 
volunteers will, on the 
average, indicate an 
inc-ease in skills and 
knowledge on at least 
002 of the identified 
needs covered in S.D. 
ao measured by a pre- 
post questionnaire. 



Reviewer A. Super Reviewer 




Jfoforcnet 
to 

SohooJ, nan 



20 



Mill t* Com 
Pletod in 
Tiae Stated? 



88 



Keeson for Defioioncy 
(if not compietoable) 



jaggaakd Action t y sag^ 



Other priorities 
intervened 



Insufficient time 



I) Pprsontt) 



S.D. . Cent- 
mi t tee 



?)Aotign to 
taken 




Reevaluation 
of S.D. prior- 
ities 

i 

Setting aside 
blocks of tlm 



3) By vhat 
data 



2/1/11 



Si 



CONSIDERATIONS IN IMPLEMENTING PROCESS 



WILLINGNESS OF STAFF AND COMMUNITY TO PARTICIPATE 
ACTIVELY AS FVALUATORS 

SUPPORT OF ADMINISTRATIVE,, INSTRUCTIONAL STAFF 
AND PARENT ADVISORY GROUPS FOR THE PROCESS 

ALLOCATION OF TIME AND PERSONNEL 

PERCEPTION OF PROCESS AS A POSITIVE WAY TO IMPROVE 
THE INSTRUCTIONAL PROGRAM 



IMPLEMENTING EVALUATION COMMITTEE 

* 

PLANNING MEETING 

INTRODUCTION OF EVALUATION COMMITTEE CONCEPT 
SELECTION OF COMMITTEE MEMBERS 
INITIAL COMMITTEE MEETING 
SUCCESSIVE MEETINGS 
END-OF-YEAR EVALUATION 



